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ABSTRACT 


The  testing  and  evaluation  of  logistic  supportab i 1 i ty  has  riot  received  the 
same  emphasis  or  attention  as  that  given  to  the  test  and  evaluation  of  the 
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EXECUTIVE  SUMMARY 


1.  Authority  for  the  Study.  The  Directorate  for  Readiness  (DRCKE-iP),  US 
Army  Materiel  Development  and  Readiness  Command  (DARCOM) ,  is  the  sponsor  of 
this  study.  Tasking  was  by  letter,  DRCPA-S,  HQ  DARCOM,  13  February  1980, 
subject:  Study  Plan  for  LSO  Project  1006.  Additional  guidance  was  provided 
by  DF  from  DRCRE-I  on  13  February  1981  as  a  result  of  a  Study  Advisory  Group 
(SAG)  meeting  on  18  September  1 980 . 

2.  Problem  Statement.  The  testing  and  evaluation  of  logistic  supportab i li ty 
has  not  received  the  same  emphasis  or  attention  as  that  given  to  the  test  and 
evaluation  of  the  hardware  subsystem.  Logistic  support  shou’d  be  afforded  a 
status  equal  to  that  of  a  hardware  subsystem  for  testing  and  for  assessing  the 
su i tab i 1 i ty-for-use  and  su i tab i 1 i ty- for- i ssue  to  the  troops  of  the  overall 
system  being  tested. 

3.  Ob j  ect  i  ves .  The  objectives  of  this  stuJy  were: 

a.  To  develop,  coordinate,  and  establish  procedures  and  actions  necessary 
to  use  Military  Occupational  Specialty  (MOS)  trained  military  personnel  as 
players  during  the  logistic  supportabi 1 i ty  phase  of  development  testing  (both 
contract  and  organic). 

b.  To  develop  procedures  and  actions  necessary  to  identify,  justify, 
program,  and  schedule  a  dedicated  logistic  supportab i 1 i ty  evaluation  and 
dedicated  prototype  models  for  use  in  logistic  suppor tab i 1 i ty  testing. 

c.  To  develop  a  life  cycle  plan  for  logistic  suppor tab i 1 i ty  testing  and 
eva 1 uat ion . 

A.  Scope  of  the  Study.  The  study  involves  a  review  of  current  regulations 
related  to  developer/user  tests  and  test  personnel.  All  Department  of  the 
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Army  (DA)  and  DARCOM  regulatory  guidance  dealing  with  logistic  suppor tab i 1 i ty 
testing  were  identified  and  analyzed.  Procedures  and  actions  needed  to 
insure  that  a  team  of  trained  military  personnel  are  available  as  players 
during  the  logistic  suppor tab i 1 i ty  phase  of  development  testing  were  examined. 

The  feasibility  of  establishing  a  dedicated  logistic  supported i 1 i ty  evaluation 
and  dedicated  prototype  models  for  use  in  testing  were  carefully  reviewed  and 
analyzed.  A  life  cycle  plan  for  logistic  suppor tab i 1 i ty  testing  and  evaluation 
has  been  prepared  for  insertion  in  DA  Pamphlet  700-127. 

5.  Methodology. 

a.  The  study  involves  a  review  of  current  regulations  related  to  developer/ 
user  tests  and  test  personnel.  All  DA  and  DARCOM  regulatory  guidance  dealing 
with  logistic  suppor tab i 1 i ty  testing  has  been  identified  and  analyzed. 

b.  Regulatory  guidance  dealing  specifically  with  Life  Cycle  Management 
Models  (LCMM)  has  been  carefully  reviewed  and  analyzed.  Documents  include 
the  foil owi ng : 

(1)  DA  Pamphlet  11-25,  Life  Cycle  System  Management  Model  for  Army 
Systems,  May  1975. 

(2)  DA  Pamphlet  700-127,  Integrated  Logistic  Support  Management  Model 
and  Glossary,  April  1979. 

(3)  DARCOM  Regulation  11-27,  Life  Cycle  Management  of  DARCOM  materiel, 

30  June  1977- 

c.  Visits  or  telephonic  communication  with  the  following  activities  were 

conducted:  US  Army  Test  and  Evaluation  Command  (TEC0M) ,  US  Army  Materiel  Systems 

Analysis  Activity  (AMSAA) ,  US  Army  Operational  Test  and  Evaluation  Agency  (0TEA) , 

US  Army  Logistics  Center  (LOGC) ,  US  Army  Materiel  Readiness  Support  Activity  (MRSA) , 
Air  Force,  and  others  as  deemed  necessary  to  research  current  procedures  and  their 
effect i veness. 


Cone  I  us i ons . 


6. 

a.  The  Five  Year  Test  Program  (FYTP)  and  the  Test  Schedule  and  Review 
Committee  (TSARC)  process  is  an  adequate  mechanism  for  acquiring  supplementary 
troop  support  for  user  testing  and  developmental  testing,, 

b.  There  is  a  need  for  each  DARCOM  test  activity  to  maintain  a  staff  of 
experienced  So! d i er/Opera tor/Ma i n ta i ne r  Test  and  Evaluation  (SOMTE)  personnel 
representing  the  full  spectrum  of  user  and  maintainer  skills  associated  with 
the  kinds  of  systems  tested  by  that  activity. 

c.  The  Table  of  Distribution  and  Allowances  (TDA)  of  each  DARCOM  test 
activity  should  designate  spaces  as  primary  SCMTE  spaces.  Such  personnel 

would  be  available  for  full-time  assignment  to  SOMTE  and  SOMTE-related  activities. 

d.  The  Test  Design  Plan  (TDP)  should  clearly  delineate  and  give  specific 
guidance  for  SOMTE  involvement  in  any  given  test  situation.  SOMTE  personnel  can 
be  effectively  utilized  for  early  contractor  testing. 

e.  A  clear  distinction  must  be  made  in  evaluating  log i st i c  .supportabi 1 i ty . 

Tiie  test  of  the  System  Support  Package  (SSP)  is  not  to  be  confused  with  those 
logistic  functions  performed  to  provide  test  continuity.  The  planned  logistic 
support  which  should  be  tested  is  that  to  be  provided  with  the  fielded  system  to 
determine  the  capability  of  planned  support  to  >ustain  operations  in  the  field. 

f .  Logistic  suppor tab i 1 i ty  evaluations  are  not  meeting  the  intent  of 
current  acquisition  policies  which  require  that  weapon  systems  and  their 
respective  logistic  systems  be  evaluated  at  milestone  decision  points  to 
assess  suitability  characteristics  and  project  operational  readiness.. 

q.  Test  programs  conducted  prior  to  Milestone  l!  have  been  oriented 
toward  "proof  of  design"  concept  with  little  emphasis  on  logistic  support¬ 
abi  I  i  t  y  „ 
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ho  Test  plans  and  policies  should  take  account  of  the  fact  that  not  all 
elements  of  logistic  support  will  be  available  in  their  mature  configuration 
for  testing  prior  to  Milestone  lll„ 

1  .  The  SSP  should  be  identified  early  in  the  life  cycle  program  as  a 
distinct  entity  and  should  be  clearly  stated  as  such  in  all  contracts  for  both 
prototype  and  production  i terns . 

jo  One  of  the  key  problems  related  to  logistic  supportab i 1 i ty  is  the  lack 
of  weapon  systems  prototype  availability  during  the  development  phases  to 
prepare  required  manuals  and  other  essential  logistic  programs.  This  problem 
can  be  resolved  by  providing  an  additional  prototype  of  the  weapon  system  which 
would  be  devoted  solely  to  logistic  supportab i i i ty  testing  during  the  Full  Scale 
Engineering  Development  (FSED)  phase. 

k.  Sufficient  hardware,  time,  and  planning  are  not  assigned  to  Physical 
Teardown/Log i s t i c  Demonstration  (PT/LD).  Sufficiently  matured  versions  of  SSP 
are  not  provided  for  test;  and  thus,  logistic  supportab i 1 i ty  testing  never  seems 
to  end  because  it  is  spread  out  over  the  developmental  time  span., 

l.  Concepts  presented  in  this  study  will  reg  .  i  re  changes  to  regjlatory 
guidance  related  to  logistic  suppor tabi 1 i ty  testing  and  evaluation. 

m„  For  logistic  supportab i 1 i ty  testing  to  be  given  proper  attention  and 
emphasis,  it  would  be  highly  desirable  to  conduct  a  dedicated  nonwa i verab I e 
Logistic  Support  Evaluation  ( L S E )  as  a  subtest  of  both  DT  I  I  and  OT  II.  Emphasis 
would  be  directed  to  testing  a  complete  SSP  or  those  elements  of  the  SSP  not 
p rev i on sly  tested. 

ru  L  i  fe  cycle  logistic  support  testing  conducted  prior  to  L.SL  should  be 
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7o  Recommendations.  It  is  recommended  that: 


a„  Each  DARCOM  test  activity  designate  certain  positions  on  their  TDAs 
as  SOMTE  spaces.  These  positions  are  to  be  further  categorized  by  their 
commitment  to  SOMTE  activities  such  as:  primary,  auxiliary,  or  temporary;  or 
by  the  level  of  their  qua  1 i f i ca t ions  as  senior,  intermediate,  or  junior. 

b„  The  TOP  clearly  define  SOMTE  responsibilities  in  any  given  test 
situation. 

c„  At  least  two  prototypes  be  procured  for  the  FSED  phase  of  the  acquisi¬ 
tion  cycle.  The  second  prototype  to  be  dedicated  exclusively  for  System  Support 
Package/Sk i 1 1  Performance  Aids  (SSP/SPA)  purposes  to  insure  that  logistic 
supportab  i  I i ty  and  training  programs  proceed  at  the  pace  required  for  testing 
and  implementation  of  the  logistic  and  training  functions. 

d Each  contractor  be  required  to  prepare  and  execute  a  Logistic  Support 
Analysis  (L.SA)  plan  which  provides  Logistics  Support  Analysis  Record  (LSAR) 
output  summaries  at  the  appropriate  time  to  support  preparation  of  draft 
documen ta t ion  - 

e,  With  the  availability  of  a  dedicated  prototype  for  SSP  purposes, 
insure  that  a  satisfactory  PT/LD  is  performed  using  Ml)S  qualified  personnel. 

The  PT/LD  is  performed  using  validated,  baseline  LSAR  output  report':  and 
draft  copies  of  Technical  Manuals  (TMs),  Extension  Training  Materiels  tETMs), 
Provisioning  Lists  (PLs),  and  Maintenance  Allocation  Charts  (MACs) . 

f.  A  dedicated  nonwa i verah 1 e  Logistic  Support  Evaluation  (l ST)  be  con¬ 
ducted  as  a  subtest  of  both  DT  II  and  OT  II.  Emphasis  i  placed  on  lest  ing 
those  elements  of  the  SSP  not  previously  tested 

g SOMTE  personnel  be  utilized  tor  early  contr.K  tot  testing 


h „  Logistic  Support  Evaluation  (LSE)  test  results  be  submitted  for 
consideration  of  an  ln~Process  Review  (!PR)  which  would  assess  the  impact  on 
planned  deployments,  assign  corrective  actions,  and  inform  DARuuM  and  Army 
management  „ 

i.  Regulatory  guidance  related  to  logistic  suppor tab i 1 i ty  test  and  evalua¬ 
tion  be  changed  as  presented  in  Appendix  A„ 
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MAIN  REPORT 


1.  Statement  of  the  Problem.  The  testing  and  evaluation  of  logistic 
suppor tab i 1 i ty  has  not  received  the  same  emphasis  or  attention  as  that  given 
to  the  test  and  evaluation  of  the  hardware  subsystem.  Logistic  support  should 
be  afforded  a  status  equal  to  that  of  a  hardware  subsystem  for  testing  and  for 
assessing  the  su  i  tab i 1 i ty-for-use  and  su i tab i 1 i ty-foi — issue  to  the  troops  of 
the  overall  system  being  tested. 

2.  Sackg-ound .  Logistics  Studies  Office  (LSO)  Project  805,  Integrated  Logis¬ 
tic  Support  (li.S)  Guide  for  Demonstration,  Test  and  Evaluation  of  Logistic 
Suppor tab i 1 i ty ,  represented  the  initial  Fiscal  Year  ( FY )  78  study  effort  on 
this  subject.  The  FY  79  phase  of  this  study  was  assigned  to  the  US  Army 

Test  and  Evaluation  Command  (TECOM)  with  the  expectation  that  TECOM's  study 
effort  would  complete  and  validate  the  methodology.  It  was  anticipated  at 
that  time  that  additional  work  might  be  assigned  to  LSO  to  provide  implemen¬ 
tation  guidance.  A  meeting  at  Headquarters,  US  Army  Materiel  Development,  and 
Readiness  Command  (HQ  DARCOM)  ,  on  11  October  1979  between  representatives  of 
the  Directorate  for  Readiness,  TECOM,  and  LSO  revealed  that  the  TECOM  study 
was  not  directly  related  to  implementation  considerations.  As  a  result,  of 
this  meeting,  the  study  objectives  and  specific  tasks  for  this  study  were 
more  clearly  outlined  and  delineated  in  the  objectives  described  below.  A 
subsequent  meeting  of  the  Study  Advisory  Group  (SAG)  on  18  September  1980 
reviewed  the  initial  draft  study  and  determined  that  additional  research  was 
needed  to  meet  the  stated  objectives  of  the  study. 
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3 .  Study  Objective s „ 

a,  Develop,  coordinate,  and  establish  procedures  and  actions  necessary 
to  use  Military  Occupational  Specialty  (MOS)  trained  military  personnel  as 
players  during  the  logistic  supportabi 1 i ty  phase  of  development  testing 
(both  contract  and  organic) . 

b„  Develop  procedures  and  actions  necessary  to  identify,  justify, 
program,  and  schedule  a  dedicated  logistic  supportabi 1 i ty  test  and  dedicated 
prototype  models  for  use  in  logistic  supportabi 1 i ty  testing. 

c.  Develop  a  life  cycle  plan  for  logistic  supportabi 1 i ty  testing  and 
eva 1 uat i on. 

Scope  of  the  Study,  The  study  will  involve  a  review  or  current  regula¬ 
tions  related  to  developer/user  tests  and  test  personnels  All  Department  of 
the  Army  (DA)  and  DARCOM  regulatory  guidance  dealing  with  logistic  support- 
ability  testing  will  be  identified  and  analyzed,  A  life  cycle  plan  for 
logistic  suppor tab i 1 i ty  testing  and  evaluation  will  be  prepared  to  include 
prerequisite  events  to  assure  accomplishment  of  the  following  required  testing 
and  evaluation:  Logistic  content  of  the  Coordinated  Test  Program  (CTP) ,  Systems 
Support  Package  (SSP)  ,  Developmental  Testing/Operational  Testing  (DT/OT)  I, 
dedicated  prototype  test  model,  logistic  suppor tab i 1 i ty  demonstration  of  DT/OT 
II,  evaluation  plan  for  logistic  suppor tab i 1 i ty ,  test  design  plan  for  logistic 
supportabi 1 i ty,  and  logistic  supportabi 1 i ty  evaluation  report.  This  task  will 
be  accomplished  by  preparing  event  blocks  of  information  for  insertion  in 
DA  Pamphlet  700-127,  Visits  will  he  made  to  US  Army  Test  and  Evaluation  Command 
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(TECOM) ,  US  Army  Materiel  Systems  Analysis  Activity  (AMSAA) ,  Operational  Test 
anc  Evaluation  Agency  (OTEA) ,  Materiel  Readiness  Support  Activity  (MRSA),  Air 
Force,  and  others  as  deemed  necessary  to  research  current  procedures  and  their 
effectiveness,.  Final  study  product.  wi  1  !  recommend  appropriate  changes  to  regula 
tory  guidance  to  meet  the  needs  of  the  objectives  stated  in  paragraph  3  above. 

5 .  0  i  scuss i on . 

a.  Test:  Personnel  Utilization.  One  of  the  areas  of  primary  investigation 
in  this  study  involves  the  use  of  MOS  trained  military  personnel  as  players 
during  the  logistic  supportabi ] i ty  phase  of  development  testing  (both  contract 
and  organic).  Upon  the  dissolution  of  the  test  boards  in  1975,  varying  numbers 
of  civilian  and  military  personnel  spaces  were  allocated  to  the  TECOM  proving 
grounds  for  the  express  purpose  of  continuing  soldier  operator  and  maintainer 
contributions  to  developmental  testing.  Reviews  of  the  Soldier  Operator 
Maintainer  Test  and  Evaluation  (SOMTE)  programs  generally  indicated  that  the 
program  was  considered  essential  and  that,  although  some  advantages  could  be 
foreseen  for  using  temporary  duty  (TOY)  personnel,  most  SOMTE  should  be 
performed  by  Tables  of  Distribution  and  Allowances  (TDA)  troops.  Problems 
identified  at  that  time  concerned  the  difficulty  in  providing  skilled  personnel 
and  the  lack  of  specificity  of  requirements  in  test  directives.  At  present, 
SOMTE  positions  are  not  identified  as  such  in  the  TDAs  of  the  proving  grounds. 

(l)  The  Five  Year  Test  Program  (FYTP)  is  a  compendium  of  approved  Outline 
Test  Plans/Resume  Sheets  (OTP/RS)  for  ali  user  testing  and  development  test¬ 
ing  requiring  supplementary  troop  support.  The  approved  FYTP  is  a  tasking 
document  for  test  execution  and  resources  allocation  developed  within  existing 
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budget/program  constraints  and  Army  priorities  for  the  current  and  budget 
year  and  provides  planning  guidance  for  the  cut  years.  The  Test  Schedule 
and  Review  Committee  (TSARC)  meets  semiannually  to  review,  update,  and 
recommend  approval  of  the  r'YTP.  DARCOM  support  of  the  TSARC  process  is 
paramount  since  approval  of  the  FYTP  places  budgetary,  materiel,  and 
support  requirements  on  the  proponent  materiel  developers.  All  OTPs  in  areas 
of  cognizance  must  be  carefully  reviewed,  paying  particular  attention  to 
equipment/item  quantity  needs,  support  requirements,  and  dates  with  their 
associated  impact  on  development  programs.  This  careful  review  must  be 
conducted  to  insure  that  imposed  requirements  bv  the  user  community  do  not 
place  undue  burdens  upon  or  adversely  impact  the  DARCGM  proponent  materiel 
developers . 

(2)  DARCOM  requirements  for  development  testing  supplementary  troop 
support  in  excess  of  the  soldier  opera tor/ma i n ta i ne r  resources  are  approved 
by  the  TSARC  process.  Approval  of  the  FYTP  constitutes  tasking  authority 
for  supplementary  troop  support  for  Developmental  Testing  (DT).  Troop  support 
forecasting  is  a  projection  of  the  total  DARCOM  (TECOM  and  proponent  materiel 
developer)  nonorganic  troop  support  requirements  for  all  testing  to  be 
accomplished  by  DARCOM  for  a  maximum  2-year  fiscal  period.  Based  on  known 
and  projected  workload,  test  agencies  and  proponent:  materiel  developers 
identify  nonorganic  troop  requirements  and  provide  DT  OTP  forecasts  to 
TECOM  (DRSTE-TO-O) .  Headquarters,  TECOM,  then  submits  consolidated  DT  OTP 
forecasts  to  the  DA  TSARC  for  coordination,  review,  and  approval.  DT  OTPs 
are  meant  to  provide  planning  information  to  the  commands  providing  the 
support  (normally  US  Army  Forces  Command/US  Army  Training  and  Doctrine 
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Command  ( FORSCOM/TRADOC ) )  and  to  enable  the  TSAR*  to  visualize  the  total 
requirement  of  nonorganic  troops  to  support  not  only  DT  but  all  testing. 

The  CTP  provides  development  and  operational  testers  and  evaluators  with 
criteria  against  which  their  tests  will  be  designed  and  the  data  evaluated. 
Supplementary  troop  support  for  DT  is  coordinated  with  appropriate  commands 
as  a  function  of  CTP  coordination.  When  test  requirements  exceed  the  capa¬ 
bility  of  the  materiel  developer,  the  needed  support  will  be  coordinated 
through  the  TSARC  process  for  approval  using  the  DT  OTP  as  the  administra¬ 
tive  documentation. 

(3)  Each  DARCOM  test  activity  should  have  as  one  of  its  primary  goals 
tne  desire  to  maintain  a  staff  of  experienced  SOMTE  personnel  representing 
the  full  spectrum  of  user  and  maintainer  skills  associated  with  the  kinds  of 
systems  tested  by  that  activity.  Test  Design  Plans  (TDPs)  and  test 
directives  should  carefully  specify  the  required  minimum  participation  of 
SOMTE  personnel  and  require  test  reports  to  provide  detailed  information  on 
SOMTE  activities.  Since  our  main  thrust  in  this  paper  is  to  consider  the 
logistic  supportab i 1 i ty  aspects  of  testing,  it  is  essential  that  emphasis  be 
placed  on  the  number  of  logistic  positions  assigned.  The  listing  of  test 
directorate  positions  should  include  a  sufficient  number  of  logistic  data 
collectors  possessing  the  proper  skills  and  experience.  Additionally,  the 
scope,  complexity,  and  criticality  of  the  test  may  necessitate  a  logistic 
member  on  the  directorate  staff. 

(4)  A  suggested  means  of  assuring  the  assignment  of  dedicated,  experienced 
personnel  is  represented  in  this  concept.  Certain  positions  on  the  TDA  of  the 
test  activity  should  be  designated  as  COMTE  spares.  These  positions  could  be 
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further  categorized  in  regards  to  their  commitment  to  SOMTE  activities;  for 
example:  primary,  auxiliary,  or  temporary;  or  by  the  level  of  their 

qualifications  as  senior,  intermediate,  and  junior. 

(a)  Primary  SOMTE  Personnel.  Those  personnel  assigned  to  TDA  spaces 
designated  as  primary  SOMTE  spaces.  Such  personnel  would  be.  available  for 
full-time  assignment  to  SOMTE  and  SOMTE- re  1 ated  activities.  The  priority 
of  assignment  for  such  personnel  are: 

•  SOMTE  test  participation. 

•  Acquisition  and  maintenance  of  MOS  and  othe.''  skills  essential 
to  SOMTE  assignment. 

•  Data  collection,  especially  as  observer/ recorder . 

•  Non-SOMTE  utilization  of  military  skills. 

(b)  Auxiliary  SOMTE  Personnel.  Those  personnel  assigned  to  non-SOMTE 
positions  who  are  available  for  SOMTE  participation  for  a  specified  portion 
of  their  duty  time;  e.g.,  25  percent.  Other  than  for  the  specified  periods 
of  SOMTE  availability,  priorities  for  assignment  are  dictated  by  their 
primary  jobs. 

(c)  Temporary  SOMTE  Personnel.  Those  personnel  either  from  within  a 
test  activity  or  in  TDY  status  from  other  commands  assigned  to  a  specific 
test  on  an  ad  hoc  basis. 

(d)  Senior  Level  SOMTE  Personnel.  Those  SOMTE  personnel  in  grades 
E-7  (skill  level  A)  and  above  possessing  extensive  experience  in  their 
primary  MOSs. 

(e)  Intermediate  Level  SOMTE  Personnel.  Those  SOMTE  personnel  in  grades 
E-6  and  E-5  (skill  levels  3  and  2)  possessing  some  field  experience  in  their 
primary  MOSs. 
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(f)  Junior  Level  SOMTE  Personnel.  Personnel  in  grades  E-4  (skill  level 


1)  and  below  not  necessarily  having  field  experience  beyond  school  or  On-the- 
Job  Training  (OJT) . 

(5)  The  anticipated  duties  of  SOMTE  personnel  require  that  they  possess 
practical  military  experience  and  the  intelligence  and  language  skills 
necessary  to  study  new  systems  and  express  their  evaluations  orally  and  in 
writing.  All  SOMTE  personnel  must  have  current,  valid  MOEs  appropriate  to 
their  positions  and  should  maintain  passing  scores  on  MOS  and  Skill  Quali¬ 
fication  Tests  (SQTs) . 

(6)  In  the  TOP,  the  chairman  of  the  task  group  should  assure  that  clear 
and  specific  guidance  for  SOMTE  involvement  is  given,  identifying  the  acti¬ 
vities  and  roles  in  which  SOMTE  personnel  are  to  participate  and  guidelines 
for  the  degree  of  participation  in  terms  of  numbers  of  miles  to  be  driven, 
rounds  to  be  fired,  percentage  of  operating  time,  or  maintenance  activity, 
etc.  Skill  levels,  MOSs,  and  crew  compositions  should  also  be  stated. 

(7)  At  the  test  activity,  the  test  project  officer  should  have  access 
to  a  senior  SOMTE  consultant  during  the  development  of  the  Detailed  Test 
Plan  (DTP).  Interaction  with  Human  Factors  Engineering  (HFE) ,  Reliability, 
Availability  and  Maintainability  (RAM),  and  safety  professionals  should  be 
established  at  this  stage.  As  required,  the  senior  SOMTE  noncommissioned 
officer  (NCO)  should  be  available  to  the  developer  and  the  contractors 
concerned.  Utilization  of  SOMTE  personnel  for  early  contractor  testing 
should  be  encouraged. 

(8)  Every  effort  should  be  made  to  assign  SOMTE  oersonnel  for  the 
duration  of  a  test  and  to  assure  that  conflicts  with  other  military  duties 
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and  personnel  actions  are  not  permitted  to  reduce  their  availability.  This 
applies  equally  to  junior  personnel  although  for  shorter  periods.  The  invest¬ 
ment  in  system  training  may  be  considerable;  consequently,  sporadic  partici¬ 
pation  in  test  activity  will  impair  the  contribution  of  individuals  and  crews. 
As  a  parallel  to  this,  all  personnel  who  make  up  the  test  team  should  be 
provided  adequate  housing  and  the  availability  of  adequate  recreational 
facilities,  particularly  in  remote  test  sites.  Test  directors  should  main¬ 
tain  a  close  liaison  with  their  personnel  at  all  times  to  assure  that  morale 
is  maintained  at  a  high  level  and  that  all  t»st  participants  are  kept  fully 
informed  of  test  proceedings  and  progress. 

(9)  An  essential  element  of  the  SOMTE  professional  development  must 
also  be  the  maintenance  of  MOS  skills  not  only  to  assure  that  the  testers 
continue  to  represent  their  military  specialties,  but  to  permit  these 
personnel  to  be  competitive  with  their  peers  in  Table  of  Organization  and 
Equipment  (TO&E)  assignments.  In  this  latter  context,  it  is  important  to 
emphasize  that  each  SOMTE  position  should  have  a  carefully  stated  job  descrip¬ 
tion  which  can  be  referenced  in  the  preparation  of  Enlisted  Efficiency  Reports 
(EERs)  which  should  reflect  the  demanding  professional  character  of  <he  SOMTE 
assignment  and  the  contribution  to  future  Army  equipment. 

(10)  Procedures  established  in  the  FYTP/TSARC  appear  to  be  as  satisfactory 
a  mechanism  as  can  be  established  to  support  user  testing  and  development  test¬ 
ing  requiring  supplementary  troop  support.  The  proposed  concept  of  assigning 
SOMTE  personnel  to  TDA  slots  can  accomplish  a  great  deal  toward  improvement 

of  DT.  Present  difficulties  related  to  the  scarcity  of  certain  enlisted  MOSs 


such  as  13  Echoes  and  3^  Gulfs  remain  a  serious  problem  requiring  the 
application  of  sound  personnel  management  actions. 

b .  Test  Classification  and  Reports. 

(1)  Testing  is  grouped  into  two  basic  categories;  Developmental  Testing 
(DT)  and  Operatioi  1  Testing  ( OT ) . 

(a)  DT  is  planned,  conducted,  and  monitored  by  the  materiel  developer 
and  is  conducted  in  factory,  laboratory,  and  proving  ground  environments 
using  qualified  and  experienced  operators,  crews,  and  maintenance  support 
personnel.  DT  insures  that  ail  significant  design  problems  and  supportab i 1 i ty 
considerations  have  been  identified  and  solutions  are  in  hand. 

(b)  OT  is  accomplished  by  operational  personnel  of  the  type  and  qualifi¬ 
cations  of  those  who  are  expected  to  use  and  maintain  the  system  when  deployed. 

OT  is  conducted  within  controlled  field  exercises  and  to  the  maximum  extent 
possible  using  TO&E  troop  units  and  maintenance  support  personnel  in  tactical 
scenarios.  All  OT  is  the  responsibility  of  and  is  managed  by  OTEA.  Usually, 

OT  is  conducted  by  OTEA  for  major  and  selected  nonmajor  systems  and  by  TRADOC, 
the  US  Army  Security  Agency  (USASA) ,  or  by  other  designated  operational  testers 
for  other  nonmajor  systems. 

(2)  The  CTP  provides  development  and  operational  testers  and  evaluators  with 
criteria  against  which  their  tests  will  be  designed  and  the  data  evaluated. 

The  CTP  is  the  key  management  tool  for  control  of  the.  integration  of  all  test 
requirements.  For  major  and  category  1  nonmajor  systems,  the  CTP  is  a  separate 
document  for  each  applicable  materiel  acquisition  phase  (CTP  I  for  Validation 
Phase,  CTP  II  for  Fu ) I  Scale  Development  Phase,  and  CTP  III  for  Production  and 
Deployment  Phase)  and  can  be  updated  pr'or  to  each  decision  review  to  reflect 
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the  current  status  of  testing.  For  category  2,  3.  and  uncategor i zed  nonmajor 
systems,  the  CTP  is  a  single,  abbreviated  document  (see  Appendix  D,  Definitions). 

(3)  The  Test  Integration  Working  Group  (TIWG)  is  the  pi  irnary  vehicle 
to  facilitate  integration  of  test  requirements  for  major  and  category  1 
nonmajor  systems  and  other  systems  jointly  agreed  to  by  the  materiel  and 
combat  developers  and  to  speed  the  coordination  of  the  CTP  during  the  acqui¬ 
sition  cycle.  For  programs  not  requiring  a  TIWG,  integration  will  be  accom¬ 
plished  during  staffing  of  related  test  documentation.  The  CTP  is  separate  from 
the  Acquisition  Plan  (AP)  ;  however,  the  CTP  is  summarized  as  Section  IV  of  the 
AP .  AR  1000-1,  dated  1  May  1981,  has  replaced  the  Outline  Acquisition  Plan  (OAP) 
and  Acquisition  Plan  (AP)  with  the  Program  Management  Plan  (PMP)  . 

{ k )  I ndependen t  Evaluation  and  Test  Plans. 

(a)  The  Independent  Evaluation  Plan  (lEP)  is  the  master  plan  for  all  aspects 
of  responsibilities  relative  to  the  testing  of  an  item  or  system. 

(b)  Outline  Test  Plan  (OTP)  contains  administrative  information,  test 
purposes,  objectives,  scopes,  resource  requirements,  and  cost  estimates.  The 
OTP  is  prepared  by  the  materiel  developer  and  the  operational  tester  respec¬ 
tively  for  each  DT  and  0T. 

(c.)  The  Test  Design  Plan  (TDP)  is  a  formal  document  which  expands  on  the 
IEP  and  reflects  as  much  planning  as  is  possible  without  knowing  the  details 
of  the  terrain  and  test  personnel  to  be  used. 

(d)  The  Detailed  Test  Plan  (DTP)  is  an  informal  document  for  a  specific 
test  prepared  by  the  test  organization  which  provides  explicit  instructions 
for  directing  every  phase  of  the  test. 

{S)  Test  and  Independent  Eva  1  eat i on  Repor  t  s . 
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(a)  Test  reports  are  formal  documents  prepared  by  the  test  director  for 
separate  tests  or  prepared  independently  by  the  deputy  test  directors  for 

a  combined  DT  end  OT.  The  test  report  will  contain  finoings  of  fact.  It 
is  among  the  primary  sources  used  to  develop  the  independent  evaluation  and 
to  update  Cost  and  Operational  Effectiveness  Analysis  (COEA)  for  the  decision 
rev i ew. 

(b)  Independent  Evaluation  (IE)  and  Report  (IER).  lEs  cf  items  and  systems 
are  based  on  reports,  studies,  and  other  appropriate  sources  and  are  made  for¬ 
mally  by  the  materiel  developer  and  operational  tester  throughout  the  materiel 
acquisition  process.  The  IE  is  continuous  and  is  the  basis  for  the  IER. 

c .  Elements  of  Logistic  Suppor tab i li ty . 

(l)  One  of  the  prime  areas  for  investigation  in  this  study  concerns  the 
scheduling  of  a  dedicated  logistic  suppor tab i 1 i ty  evaluation  and  dedicated 
prototype  models  for  use  in  logistic  suppor tab i 1 i ty  testing.  It  is  important 
at  this  point  in  our  discussion  to  define  carefully  the  terms  used  to  describe 
"logistic  suppor tab i 1 i ty . "  Integrated  Logistic  Support  ( I L S )  is  the  manage¬ 
ment  process  through  which  logistic  support  considerations  and  maintenance 
techniques  are  integrated  into  the  design  effort.  The  System  Support  Package 
(SSP)  is  a  composite  package  of  support  elements  required  to  keep  a  materiel 
system  in  an  operationally  ready  condition.  The  SSP  was  formerly  called  the 
Maintenance  Test  Support  Package  (MTSP) .  The  SSP  has  six  basic  elements 
as  stated  in  DA  Pamphlet  700-127  which  are  essential  to  the  support 
of  the  system  in  the  field.  Each  of  these  distinct  elements  is  identified 
here  and  b r i e f I y  u esc r i bed  : 

(a)  Suppor  t  urd  Test  Equ i pinen  t .  All  equipment,  mobile  or  fixed,  required 
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to  support  the  operation  and  maintenance  of  a  materiel  system  or  facilities 
at  all  locations  to  which  a  deployment  is  planned, 

(b)  Supply  Support.  All  management  actions  and  execution  necessary  for 
determining  requirements  for  acquiring,  cataloging,  packaging,  preserving, 
receiving,  storing,  transferr ing ,  issuing,  and  disposing  of  both  principal 
and  secondary  items, 

(c)  Transportation  and  Handling.  Engineering  for  transportability  during 
materiel  design  and  the  procedures,  equipment,  and  facilities  used  for  packing, 
crating,  handling,  and  transporting  materiel  systems. 

(d)  Technical  Data.  Encompasses  ail  types  of  specifications,  standards, 
engineering  drawings,  instructions,  reports,  equipment  publications,  tabular 
data,  and  test  results  used  in  the  development,  production,  testing,  use, 
maintenance,  demilitarization,  detoxification,  and  disposal  of  military  items, 
equipment,  and  systems, 

(e)  Fac i 1 i t ies .  Construction  requirements  to  support  the  materiel  system 
involved;  for  example,  buildings,  concrete  pads,  revetments,  roads,  utilities, 
and  other  peculiar  requirements  to  include  facility  equipment. 

(f)  Personnel  and  Training,  The  appropriate  number  of  personnel  with  the 
necessary  skills  to  operate  and  to  support  a  materiel  system  in  its  operational 
environment.  The  processes,  procedures,  and  equipment  used  to  train  personnel 
in  the  operation  and  support  ol  a  materiel  system. 

(2)  It  is  important  to  emphasize  at  this  point  that  a  clear  distinction 
must  be  made  in  evaluating  logistic  suppor tab i 1 i ty .  The  testing  of  the  SSP 
is  not  to  be  con  I  used  with  those  legist  it  timet  ions  perlotned  to  provide  test, 
continuity.  Logistic  personnel  must  insure  that  tests  include  ('Valuation  of 
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the  inherent  supportab i 1 i ty  of  the  materiel  system  and  the  adequacy  of 
the  planned  support  system.  This  can  be  stated  another  way  for  emphasis. 

The  logistic  support  required  to  sustain  the  continuity  of  tests  and  demon¬ 
strations  is  a  distinctly  separate  function  and-  :s  the  responsibility  of  the 
development  command/Project  Manager  (PM).  Logistic  support  for  test  continuity 
is  not  intended  to  be  evaluated  by  development  or  operation  test  and  evaluation, 
product  improvement  tests,  or  by  First  Article-Ini tial  Production  Test  (FA-IPT). 
The  planned  logistic  support  which  should  be  tested  is  that  to  be  provided  with 
the  fielded  system  to  determine  the  capability  of  planned  support  to  sustain 
operations  in  the  field.  The  SSP  should  be  afforded  a  status  equal  to  that  of 
a  hardware  subsystem  for  testing  and  for  assessing  the  su  i  tab i 1 i ty- for-use 
and  sui tab i 1 i ty-for- i ssue  to  the  troops  of  the  overall  system  being  tested. 

(3)  The  SSP  Component  Listing  also  should  not  be  confused  with  the  testing 
performed  in  support  of  deployment.  At  least  60  days  prior  to  the  date  of  each 
test  initiation,  the  SSP  Component  Listing  (prepared  by  the  materiel  developer/ 
PM)  is  forwarded  to  the  tester  for  review  and  evaluation.  The  SSP  Component 
Listing  simply  enable.)  a  testing  activity  to  plan  its  test,  whether  DT  or  01  , 
on  the  dates  specified  in  applicable  Test  Design  Plans  or  the  OTP/RS  in  order 
to  implement  the  CTP,  The  SSP  Component  Listing  should  not  be  evaluated  as  an 
element  of  the  SSP.  Its  completeness,  timeliness,  and  adequacy  should  have  no 
bearing  on  the  tina!  rating  assessed  the  SSP. 

(A)  Army  Regulation  (AR)  1 000- 1  slates  that  system  apporr  plnnnirii, 
actions  will  he  addressed  in  the  Let  ter  of  Agreement  arid  in  the  Out  I  i  ne 
Acquisition  Plan  (now  Program  Management  Plant.  Detailed  support  planning 
will  begin  during  the  Demons  I  rat  ion  and  Validation  Phase  and  I  i tor  .npport 
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requirements  will  be  established  early  in  the  Full  Scale  Engineering  Develop¬ 
ment  (FSEO)  phase.  A  preliminary  system  support  package  will  be  evaluated 
during  OT  I;  a  complete  system  support  package  will  be  validated  before 
Milestone  111  which  means  prior  to  the  production  and  deployment  decision. 

AR  1000-1  further  states  that  if  test  results  reflect  significant  deficiencies, 
including  deficiencies  in  the  system  support  packaoe,  the  program  will  not  move 
into  a  succeeding  phase  until  all  signifies. deficiencies  have  been  corrected 
and  corrections  verified  by  retest.  Surficient  test  hardware  and  elements  of 
the  system  support  package  will  be  procured  early  enough  to  prepare  for  vali¬ 
dation  during  DT/OT  II.  Detailed  planning  will  begin  during  the  demonstration 
and  validation  phase  so  that,  preliminary  logistics,  personnel,  and  training 
support  packages  may  be  evaluated  during  DT/OT  I  and  firm  requirements  can  be 
es  tab  1  i  shed  early  in  the  FSF.D  phase. 

d„  M andatory/Opt ional  1 15  Tes t i ng. 

(l)  DARCOM-R  700-15  states  that  a  logistic  demonstration  including  a 
Physical  Teardown/Log i st i c  Demonstration  (PT/LD)  and  Skill  Performance  Aids 
(SPAs)  verification,  when  required,  will  be  contained  and  scheduled  in  the  CTP 
and  the  Test  and  Evaluation  Master  Plan  (TEMP),  in  accordance  with  D00 
Directive  5000.3.  The  PT/LD  will  be  conducted  at  the  contractor's  plant, 
maintenance  engineering  evaluation  facility,  or  test,  site  and  should  be 
completed  at  least  six  (6)  months  prior  to  the  scheduled  start  date  for 
DT  II. 

(2.)  DARCOM-R  700-15  further  states  that  the  testing  of  the  SSP  will  be 
scheduled  as  part  of  the  CTP.  The  evaluation  of  logistic  supportat i 1 i ty  of 
the  materiel  system,  its  support,  and  the  adequacy  of  the  SSP  is  mandatory. 


20 


(3)  AR  700-127  and  AR  1000-1  are  generally  in  agreement  in  stating  that 
the  materiel  developers,  working  with  the  combat,  developers,  training  developers, 
testers,  and  evaluators  will  insure  that  the  SSP  is  thoroughly  tested  and 
evaluated  during  DT  II,  0T  II,  and  first  article  testing.  These  regulations 
further  state  that  preliminary  logistics,  personnel,  3nd  training  support 
packages  may  be  evaluated  during  DT  I  and  0T  I.  The  requirement  to  accomplish 
SSP  testing  in  DT/OT  I  is  reduced  or  tailored  to  the  need  whereas  the  requirement 
for  SSP  testing  during  DT/OT  II  is  mandatory0 

(M  In  accordance  with  AR  702-3,  RAH  will  be  tested  during  both  DT  and  0T 
All  RAM  testing  will  be  designed  to  complement,  not  duplicate,  and  contribute 
to  a  broad,  consistent  RAM  data  base.  DT  provides  a  measure  of  system  RAH 
against  stated  specifications  in  a  controlled  environment  with  the  procedures 
and  resources  contained  and/or  described  in  the  SSP.  The  emphasis  is  on: 

(a)  An  assessment  cf  RAM  growth. 

(b)  Assessing  the  consequences  of  any  differences  anticipated  during  field 
operat i ons . 

(c)  Resolving  legal  (contractual)  issues  between  the  Government  and  its 
contractor , 

(d)  Providing  data  to  the  RAM  data  base  for  aggregation  and  ROC  requirements 
assessment . 

(e)  Obtaining  a  clear  understanding  and  identification  of  failures  and  the 
basis  for  taking  corrective  measures  on  failure  modes. 

(5)  0T  assesses  the  RAM  performance  characteristics  on  exposure  of  the 
materiel  to  a  variety  of  expected  operational  conditions.  0T  concentrates  on 
the  mission  consequences  associated  with  using  the  system,  the  system's  opera¬ 
tional  suitability  and  operational  effectiveness,  and  the  RAM  performance  when 
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in  the  hands  of  typical  user  troops  under  operational  conditions.  OT  provides 
data  for  the  estimation  of  life  cycle  costs  and  logistic  resource  requirements, 
and  provides  a  basis  for  improving  the  non-materiel  aspects  of  RAM  oer  f  orrnance . 
The  OT  independent  evaluation  will  present  the  RAM  values  which  have  been 
statistically  aggregated  from  both  DT  and  OT .  These  values  are  expected  to  be 
most  indicative  of  future  field  performance. 

(6)  A  review  of  DA  Pamphlet  700-127,  US  Management  Model  and  Glossary; 

DA  Pamphlet  11-25,  Life  Cycle  System  Management  Model  for  Army  Systems;  and 
DARCOM-R  11-27,  Life  Cycle  Management  of  DARCOM  Materiel,  identifies  a  number 
of  logistic  suppor tab i 1 i ty  events  which  should  be  accomplished.  Since  these 
documents  only  provide  guidance,  these  additional  events  would  have  to  be  des¬ 
cribed  as  optional  requirements.  Certain  limited  actions  preparatory  to  the 
initiation  of  production  may  be  authorized  to  begin  before  Milestone  111.  These 
actions  include: 

(a)  Manufacture  of  selected  items  of  tooling. 

(b)  Procurement  of  restricted  amounts  of  critical  long  leadtime  items  as 
provided  for  in  the  congressional  approval  process.  Procurement  normally  will 
be  undertaken  only  when  DT/OT  li  testing  is  far  enough  along  to  give  reasonable 
confidence  of  satisfactory  completion.  In  addition,  long-lead  procurement  will 
be  used  only  for  relatively  modest  dollar  amounts  and  for  items  whose  leadtimes 
are  highly  leveraged  in  terms  of  avoiding  delays  and  increased  costs. 

(7)  DARCOM-R  700-15  states  that  failure  to  test  a  complete  S5P  during 

DT  II  and  OT  II  is  a  bar  to  a  production  decision.  If  significant  deficiencies 
are  found,  cor rect i ons  will  be  made  and,  prior  to  a  production  decision,  a  DT/OT 
ila  will  be  conducted.  (See  Figure  1  for  a  graphic,  picture  of  ILS  testing)  . 
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(8)  Subsequent  paragraphs  in  this  report  discuss  many  of  the  difficulties 
encountered  in  conducting  logistic  supportab i 1  i  ty  testing  and  evaluation.  In 
spite  of  the  adequacy  of  the  regulations  which  cover  ILS  testing,  the  factors 
which  contribute  to  voids  and  deficiencies  in  testing  are  hardware  immaturity, 
granting  of  waivers,  and  generally  the  failure  of  the  logistic  team  to  do  an 
adequate  job  of  incorporating  ILS  requirements  in  the  CTP  and  other  test  docu¬ 
mentation.  The  TIWG  is  the  ideal  forum  for  determining  if  all  elements  of 
ILS  are.  being  tested „ 

e  0  Ope rat i ona 1  Su i tab i 1 i t y . 

(1)  Operational  suitability  has  become  a  major  topic  in  the  Defense  System 
Acquisition  Review  Council /Army  System  Acquisition  Review  Council  (DSARC/ASAPC ) 
In-Process  Reviews  (iPRs)  with  particular  emphasis  being  placed  on  RAM  and 
’ogistic  supportab i 1 i ty  of  new  weapon  systems.  This  interest  can  be  attributed 
to  the  growing  concern  about  the  materiel  leadiness  of  our  forces  and  associated 
operating  and  support  costs  both  near-term  and  in  the  out  years.  There  is  a 
desire  to  avoid  the  readiness  problems  and  support  resource  shortages  experienced 
on  some  weapons  fielded  in  the  past  decade.  The  weapons  systems  of  the  19C0s 
will  be  even  more  complex;  skilled  manpower  is  likely  tc  become  increasingly 
scarce,  and  operating  arid  support,  budgets  are  not  likely  to  increase.  Hence, 
responsible  individual  at  every  level  have  taken  a  keen  interest  in  the  system 
suitability  characteristics  that  drive  the  support  resource  requirements  and 
readiness  of  new  weapon  systems. 

(2)  Assessment  of  system  operational  suitability  under  any  condition  is 
a  complex  undertaking.  However,  there  are  a  number  of  factors  and  conditions 
surrounding  the  review  of  systems,  particularly  prior  to  fielding  which  makes 
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the  process  more  difficult  and  demanding.  Some  of  these  problems  center  around 
test  hardware  immaturity,  lack  of  representative  support  and  test  equipment, 
nonrepresentative  training,  artificial  test  environments,  and  the  complex 
nature  of  weapon  systems  and  their  supporting  logistic  systems.  In  addition 
to  these  inherent  technical  problems,  many  development  programs  ha  ye  been 
compressed  to  meet  tight  and  concurrent  schedule  objectives.  As  a  result, 
insufficient  time  and  test  articles  have  often  been  programmed  to  test  and 
evaluate  the  supportab  i  1 i ty  characteristics  of  development  hardware  and  to 
gain  confidence  in  meeting  production  hardware  suitability  goals.  Thus,  in 
many  cases,  operational  suitability  evaluations  are  not  meeting  the  intent  of 
the  new  acquisition  policies  which  require  that  weapon  systems  and  their 
respective  logistic  systems  be  evaluated  at  milestone  decision  points  to 
assess  suitability  characteristics  and  project  operational  readiness. 

f.  Limitations  on  Pre-Milestone  It  Testing.  Test  programs  conducted 
prior  to  Milestone  II  have  been  oriented  toward  "proof  of  design  concept" 
with  little  emphasis  on  operational  suitability.  Early,  direct  measurement 
of  operational  suitability  character i st i cs  has  been  limited  because  the  test 
hardware  is  not  representative  of  the  production  designP  and  maintenance  is 
conducted  in  a  contractor  support  environment.  However,  limited  test  results 
augmented  by  analytical  methods  have  been  used  by  some  programs  to  develop 
early  operational  suitability  projections.  Criteria  are  needed  for  defining 
reasonable  operational  suitability  evaluation  objectives  for  Pre-Milestone  II 
testing.  At  a  minimum,  such  testing  should  include  an  evaluation  of  hardware 
features  which  affect  the  feasibility  of  Ine  maintenance  concept  and  an  assess¬ 
ment  of  risk  areas  and  improvements  which  will  be  requin  J  to  reach  Milestone 
III  t  hresho Ids. 
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g ,  Limitations  on  Pre-Milestone  111  Testing. 


(1)  It  would  be  desirable  to  fully  demonstrate  logistic  suppor tab i 1 i ty 
before  production  decisions.  However,  it  is  not  realistic  to  expect  that  all 
elements  of  logistic  support  will  be  available  in  their  mature  configuration 
for  testing  prior  to  Milestone  III.  Test  plans  and  policies  should  take 
account  of  this  reality.  Suitability  evaluations  should  be  structured  to 
combine  direct  observation  of  elements  that  are  expected  to  be  available 
with  analytical  techniques  to  project  the  characteristics  of  those  that  will 
not  be  available  for  testing.  Acquisition  planning  guidelines  are  needed 

to  define  logistic  elements  that  should  reasonably  be  made  available  for  test 
before  Milestone  III.  When  tradeoffs  are  required  to  meet  cost  and  schedule 
constraints,  priority  should  be  given  to  making  available  as  early  as  possible 
haidware  items  which  will  be  committed  in  the  Milestone  Ml  decision.  Clearly 
defined  schedules  and  evaluation  criteria  should  be  established  for  early 
Post-Mi  1 estone  III  test  and  evaluation  of  major  support  issues  that  were  not 
assessed  prior  to  the  production  decision. 

(2)  The  services  generally  agree  that  the  evaluation  of  supply  support 
of  system  peculiar  items  is  limited  to  simulation  or  paper  analysis.  Two 
programs  are  cited  as  examples  where  programs  were  accelerated  and  development 
of  logistic  elements  have  lagged  the  hardware  development  resulting  in  delays 
in  testing  the  logistic  elements.  The  AEGIS  (a  naval  missile  system)  is  so 
complex  that  it  will  not  be  tested  as  a  complete  up-to-date  system  until 
delivery  of  the  first  AEGIS  ship  in  1983-  The  DSARC  III  production  decision 
in  January  1978  was  based  on  subsystem  tests  conducted  on  various  ships  and 
the  AEGIS  land-based  test  site. 
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(3)  Similarly,  the  Navy  plans  a  four-year  phased  support  program  for  the 
F- 1 8 .  In  this  program,  the  contractor  will  provide  on-line  and  depot  support 
when  the  aircraft  is  first  deployed.  As  procedures  are  developed  and  proven 
and  Navy  personnel  trained,  support  will  be  transferred  to  Navy  personnel.  At 
the  end  of  the  program,  the  Navy  will  provide  all  support  for  the  aircraft. 

(4)  The  Army  is  not  unlike  the  Navy  in  this  respect;  Single  Channel  Ground 
and  Airborne  Radio  Subsystem  (SINGARS),  Advanced  Attack  Helicopter  (AAH) ,  and 
PATRIOT  (a  term  used  for  an  Army  surface-to-air  missile  system)  will  require 
some  type  of  contractor  depot  support  when  these  systems  are  fielded. 

h.  Pre-Milestone  II  Planning.  What  can  be  done  to  assure  better  planning 
and  assessment  of  logistic  supportab i 1 i ty  features  before  Milestone  II?  The 
design  during  this  stage  is  very  soft.  The  best  means  to  assure  better  planning 
and  assessment  of  logistic  supportab i  1 i ty  is  to  get  the  logisticians  actively 
involved  in  the  design  process  during  this  period.  Secondly,  have  a  logistic 
team  involved  in  the  planning,  conduct,  and  evaluation  of  testing  to  assure 
that  potential  logistic  supportab i 1 i ty  problems  are  discovered  and  the  necessary 
design  changes  or  corrections  to  the  logistics  concepts  are  made  before  these 
des i gns  are  firm. 

i.  Acquisition  Cycle  Planning.  At  what  point  in  the  acquisition  cycle 

do  you  believe  the  various  logistic  elements  can  be  defined,  analyzed,  tested, 
and  evaluated?  The  system  concept  and  design  is  so  soft  prior  to  Milestone  I 
that  only  a  list  of  applicable  logistic  parameters  can  be  identified.  The 
analysis  and  actual  development  of  quantifiable  requirements  cannot  be  accom¬ 
plished  until  after  Milestone  I  when  the  concept  is  at  least  firmed  up.  Com¬ 
plete  test  and  evaluation  of  availability  and  logistic  supportab i 1 i ty  in  many 
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cases  can  only  be  accomplished  after  Milestone  III  when  complete  logistic 
elements  are  available  and  logistic  support  systems  operable. 

j.  Post-Milestone  III  Planning.  What  should  be  done  beyond  Milestone  III 
to  identify  and  correct  or  accommodate  logistic  deficiencies?  The  only  means 
to  identify  logistic  deficiencies  beyond  Milestone  III,  which  basically  means 
that  the  system  is  fielded,  is  through  some  type  of  data  feedback  program. 

For  those  cases  where  there  are  more  than  minimal  'isks  involved  with  the 
logistic  supportabi 1 i ty  of  major  systems,  then  testing  of  production  systems 
with  the  Initial  Operational  Capability  (IOC)  unit  should  be  required.  An 
alternative  for  identifying  deficiencies  would  be  to  establish  a  short-term 
field  data  collection  program  when  the  system  is  fielded.  Once  a  logistic 
deficiency  is  identified,  a  cost  analysis  would  be  required  to  justify  correct¬ 
ing  the  deficiency  (i.e.,  the  cost  of  the  correction  must  be  offset  by  a  reduc¬ 
tion  in  the  support  costs  and/or  the  improvement  in  the  system  effectiveness). 
More  comprehensive  Test  and  Evaluation  (T&E)  programs  are  needed  to  provide 

the  desired  confidence  that  hardware  design  and  support  characteristic  measured 
or  determined  prior  to  major  decision  milestones  are  reasonably  indicative  of 
the  performance  that  can  be  expected  during  operational  service. 

k .  System  Support  Package  (SSP)  Identification. 

(1)  Other  studies  conducted  recently  have  emphasized  that  the  SSP 
should  be  identified  early  in  the  life  cycle  program  as  a  distinct  entity 
and  should  be  clearly  stated  as  such  in  all  contracts  for  both  prototype 
and  production  items. 

(2)  Elements  of  the  SSP  should  be  fully  documented  in  the  system 
contract.  Furthermore,  guidance  provided  in  current  Army  acquisition 
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regulations  should  be  changed  in  order  that  the  CTF  and  TIWu  (if  one  is 
planned)  be  established  prior  to  contract  award.  The  CTP  would  document  the 
SSP  requirements  and  be  included  as  part  of  the  system  contract. 

1 .  Prototype  Availability . 

(1)  One  of  the  key  problems  related  to  logistic  supportab i 1 i ty  is  the 
lack  of  weapon  systems  prototype  availability  during  the  development  phases 
to  prepare  required  manuals  and  other  essential  logistic  programs.  The 
primary  reason  for  this  deficiency  is  that  priority  for  prototypes  is  always 
given  to  performance  testing  and  evaluation  and  design  changes.  For  the 
logistic  supportab i 1 i ty  program  to  be  effective  including  technical  manual 
and  training  requ i rements ,  it  must  run  a  parallel  course  with  hardware  develo- 
ment  and  have  proper  evaluation  during  DT/OT  II.  Historically,  where  the 
logistic  supportabi 1 i ty  program  has  lagged  or  been  inadequate,  the  ultimate 
user  (the  soldier  in  the  field)  has  paid  a  high  price  in  operational  diffi¬ 
culties.  Units  suffered  low  readiness  rates  and  increased  maintenance 
costs.  One  solution  to  this  problem  is  to  provide  an  additional  prototype 
of  the  weapon  system  which  would  be  dedicated  solely  to  ILS  and  Skill 
Performance  Aids  (SPA)  during  the  FSED  phase.  AR  1000-1  states  that  dedicated 
prototypes  should  be  considered  for  use  in  developing  SSP  and  support  concepts. 
This  would  insure  that  the  ILS  planners  are  completely  up-to-date  with  the 
hardware  developers.  It  would  also  provide  for  substantive  ILS  recom¬ 
mendations  for  change  during  the  development  period.  While  this  proposed 
course  of  action  would  require  additional  funds  during  the  Research  and 
Development  (R6D)  phase,  this  effort  would  likely  be  cost  effective  due  to 
savings  in  operating  and  support  costs  after  fielding  and  in  training  time. 
Further,  this  proposal  would  result  in  early  turnover  to  1 RADOC  of  a  prototype 
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for  the  training  base  which  would  be  offset  by  a  reduction  in  production 
models  which  are  normally  sent  to  the  training  base. 

m  „  1  na  d  e  quacy  of  logistic.  S  uppor  tab  i  1  i  ty  and  Corrective  Measures. 

(l)  The  logistic  supportabi 1 i ty  of  new  and  product  improved  Army  materiel 
has  been  inadequate  because  of  the  Army's  difficulties  in  resolving  clearly 
identified  problem  areas.  This  ineffectiveness  can  be  attributed  in  large 
part  to  the  untimely  development  of  SSP  elements,  waivering  of  requirements 
for  logistic  support  testing  as  required  in  current  regulations,  and  the 
conduct  of  multiple  evaluations  which  only  partially  evaluate  supportabi 1 i ty. 
Additionally,  despite  the  requirements  of  AR  1C00-1,  materiel  development 
continues  to  be  cate  (IOC)  oriented  rather  than  event  oriented. 

12)  In  the  present  environment,  Logistic  Support  Analysis  Record  (LSAR) 
data  and  SSP  are  frequently  developed  simultaneously  rather  than  sequentially. 
Also,  sufficient  hardware,  time,  and  planning  are  not  assigned  to  Physical 
Teardowri/Log i st i c  Demonstration  (PT/LD).  Sufficiently  matured  versions  of  SSP 
are  not  provided  for  test;  and  thus,  logistic  suppor tab i 1 i ty  testing  never  seems 
to  end  because  it  is  spread  out  over  the  developmenta1  time  span. 

(3)  Correction  of  logistic  suppor tab i 1 i ty  problems  requires  innovative 
application  of  existing  I LS  policies  and  changes  in  Army  testing  methodology 
to  verify  the  worth  of  prescribed  elements  of  support.  The  following 
recommendations  are  proposed  for  consideration  and  action  as  appropriate  t:o 
correct  deficiencies: 

(a)  Require  that  each  contractor  prepare  and  execute  a  Logistic  Support 
Analysis  (LSA)  plan  which  provides  LSAR  output  summaries  at  the  appropriate 
time  to  support  preparation  of  draft  documentation. 
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V b )  Have  sufficient  hardware  and  the  required  troops  to  support  a  satis¬ 
factory  Physical  Teardown/Log i st i c  Demonstration  (PT/LD) .  The  PT/LD  should 
be  conducted  using  validated,  baseline  LSAR  output  reports  and  draft  copies 
of  Technical  Manuals  O'Ms) ,  Extension  Training  Materials  (ETMs),  Provisioning 
Lists  (PLs),  and  Maintenance  Allocation  Charts  (MACs) „ 

\.c)  Conduct  a  dedicated,  nonwa  i  verab  1  e  Logistic  Support  Evaluation  (LSE) 
as  a  subtest  of  both  DT  II  and  OT  11.  These  assessments  would  be  conducted 
within  the  normally  prescribed  settings  already  established  for  conducting 
DT/OT  I!  but  would  emphasize  and  be  dedicated  to  logistic  suppor tab i 1 i ty  pro¬ 
blems.  Since  the  SSP  receives  only  preliminary  examination  during  DT/OT  I, 
the  major  emphasis  would  be  on  testing  a  complete  SSP.  The  subtest  would  fit 
in  with  the  overall  scenarios  established  for  DT/OT  II  wherever  possible. 

Those  logistic  elements  not  adaptable  to  the  overall  scenario  would  be  evaluated 
on  a  stand-alone  basis.  Duplication  of  testing  would  be  avoided,.  This  means 
that  a  carefully  orchestrated  plan  for  DT/OT  II  and  the  subtest  would  have  to 

be  prepared.  The  advantage,  of  the  LSE  lies  in  the  fact  that  logistic  support 

will  be  afforded  a  status  equal  to  that,  of  the  hardware  system  for  testing  and 
evaluation.  If  the  recommendu t i on  for  conducting  a  dedicated  LSE  is  not 
approved  as  a  viable  solution  to  the  logistic  suppor tab i 1 i ty  rest  and  evaluation 
problem,  on  alternative  would  be  to  continue  testing  logistic  suppor tab  i  1 i l y 
as  now  currently  conceived  and  rely  on  a  DT/O'i  llu  test  to  resolve  any  problem 

areas  remaining.  Paragraph  5j  of  this  report  discusses  the  means  to  identify 

and  correct,  deficiencies  beyond  Milestone  111. 

\d)  The  Logistic  Support  Evaluation  (LSE)  should  occur  using  prototype 
hardware,  TRADOC  trained  personnel,  final  draft  equipment  publications, 
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specifically  designated  special  and  common  tools  and  test  equipment,  and  parts 
proposed  for  Prescribed  Load  Lists  (PLLs)  and  Authorized  Stockage  Lists  (ASLs)„ 

(e)  Results  of  the  test  would  be  submitted  for  consideration  of  an  IPR 
which  would  assess  the  impact  on  planned  deployments,  assign  corrective  actions, 
and  inform  DARCOH  and  Army  management, 

(f)  Life  cycle  logistic  support  testing  conducted  prior  to  the  Logistic 
Support  Evaluation  (l.SE)  would  be  at  the  discretion  of  the  PM  and  should  be 
limited  to  that  effort  needed  to  assure  sufficiently  matured  elements  of 
support  are  available  at  the  time  of  LSE.  Early  logistic  testing  efforts 
could  well  be  considered  as  an  integral  part  of  the  end  item  tests  and  not 
scored  separately.  These  tests  would  be  supported  only  by  a  test  support 
package  (that  amount  of  hardware  and  support  elements  required  to  conduct  the 
specific  tests  outlined  in  the  Coordinated  Test  Program).  These  packages  need 
not  be  subjected  to  the  numerous  administrative  actions  and  delays  now  surround¬ 
ing  the  processing  and  scoring  of  SSPs.  By  adopting  the  above  recommended 
changes,  the  PMO  (with  full  charter  authority  and  responsibility)  would  be. 
clearly  faced  with  the  need  to  point  his  developmental  logistical  testing 
effort  to  one  nonwa i ve rab 1 e  SSP  in  support  of  a  single  comprehensive  LSE. 
Results  of  the  LSE  would  identify  the  true  value  of  matured  versions  of  the 
elements  of  logistic  support.  Problem  areas  would  be  assigned  for  corrective 
action  by  an  official  IPR  board  and  all  resu 1 t s/recommendat ions  reported  to 
DARCOM  and  Army  management. 

(q)  Logistic  Support  Evaluation  (l.SE)  problem  areas  should  be  candidates 
for  inclusion  i  r.  Sample  Data  Collection  (SDC )  plans  and  the  el  ♦  oc  t  i  vene-.s  ot 
corrective  action  could  be  identified  for  cons i de1  a t ion  of  management  at  IOC 
plus  !  year  . 
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n  .  Testing  Logistic  Suppor tab ? 1 i ty . 

(1)  Development  Test  i  (DT  I).  DT  1  occurs  in  the  DVAL  phase  to  demon¬ 
strate  fundamentally  that  technical  risks  have  been  identified  and  that 
solutions  are  in  hand.  Components,  subsystems,  brassboard  configurations  or 
advanced  development  prototypes,  are  examined  to  evaluate  the  potential 
application  of  technology  and  related  design  approaches  prior  to  entry  into 
full-scale  development.  Depending  on  the  technological  and  materiel  si  lus, 

DT  I  will  be  complete  and  thorough  enough  to  determine  component  interface 
problems  and  equipment  performance  capability.  Such  testing  could  preclude 
the  need  to  repeat  similar  subtests  in  later  testing;  however,  a  careful 
assessment  must  be  made  to  insure  that  changes  to  the  requirements  and/or 
design  baselines  have  not  negated  earlier  test  results.  The  evaluation  by  the 
materiel  developer  will  also  include  an  initial  environmental  assessment. 

(2)  Development  Test  II  (DT  ll).  DT  II  provides  the  final  technical  data 
for  determining  the  system's  readiness  for  transition  into  either  the  low-rate 
initial  production  portion  or  the  full  production  portion  of  the  production  and 
deployment  phase.  DT  I  I  is  character i zed  by  the  use  of  engineering  and  scienti¬ 
fic  approaches  under  controlled  conditions  to  provide  quantitative  and  quali¬ 
tative  data  tor  use  in  an  independent  DT  evaluation.  DT  I  I  measures  the 
technical  performance  (including  RAM,  compatibility,  interoperability,  safety, 
and  suppor tab i 1 i t y  considerations)  of  an  item  or  system  and  its  associated 
support  equipment  and  development  training  and  system  • upper t  packages. 

DT  II  includes  tests  of  human  engineering  and  technical  aspects  of  associated 
training  devices  and  methods.  DT  II  demonstrates  whether  engineering  is 
reasonably  complete  and  whether  solutions  to  all  s i gn i t i can t  design  problem'. 
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ure  in  hand.  A1 i  OT  during  engineering  development  is  planned  as  one  integrated 
test  cycle.  In  planning  for  DT ,  the  materiel  developer  will  insure  that  mini¬ 
mum  testing  and  expenditure  of  test  resources  is  reflected  in  the  CTP  by 
requiring  maximum  exchange  of  test  data  by  the  contractor  and  materiel  developer, 
individual  soldiers  and  vehicle  or  weapons  crews  (experienced  military  personnel, 
including  maintenance  personnel)  should  be  trained  under  the  New  Equipment 
Training  Plan  (NETP) .  If  significant  deficiencies  are  found  during  DT  II, 
provisions  are  made  for  conducting  a  DT  i la. 

(3)  Operational  Testing  (OT) .  Logistic  suppor tab i 1 i ty  will  be  a  critical 
issue  during  OT.  OT  I  logistic  supportab i 1 t ty  emphasis  is  directed  toward 
identifying  problems  for  resolution  prior  to  OT  II  with  emphasis  on  organi¬ 
zational  echelons  of  support.  OT  11  emphasis  is  directed  toward  determining 
whether  the  materiel  system  is  supportable  through  general  support  echelons 

of  s.iopor't  when  supported  by  the  planned  assets  in  accordance  with  the  logistic 
concent . 

(4)  QT  i  Evaluation  Planning.  OT  I  will  be  cor, ducted  using  representative 
prototype  hardware,  support  equipment,  and  training  programs  when  feasible  and 
practical.  By  nature  of  the  development  process,  these  items  may  not.  be  of 
such  maturity  that  OT  I  will  yield  substantial  logistic  data.  Therefore,  the 
evaluation  plan  should  emphasize  the  review  of  logistic  support  documentation 
and  rely  less  on  empirical  test  data.  The  evaluator  should  Le  interested 
primarily  in  assuring  that  logistics  is  being  properly  considered  and  that 
appropriate  actions  in  the  logistic  support  bi I i ty  development  area  are 
underway.  There  will  be  some  information  which  can  be  obtained  from  OT  I 
which,  although  mcstl /  subjective  in  nature,  will  be  useful  in  confirming 
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the  basic  approach  to  the  logistic  suppor tab i 1 i ty  concept  for  the  system.  The 
evaluator  should  guide  and  support  the  tester  to  insure  the  necessary  data  are 
obtained  and  are  meaningful. 

(5)  OT  II  Evaluation  Planning.  The  evaluation  of  logistic  suppor tab i I i ty 
at  OT  M  should  rely  much  more  on  empirical  test  data.  The  test  should  be 
conducted  in  as  realistic  an  operational  environment  as  possible  using  mature 
hardware  and  software  in  accordance  with  logistic  suppor tab i 1 i ty  concepts. 

While  the  OT  II  results  will  be  heavily  relied  upon  for  validation  of  logistic 
suppor tab i 1 i ty ,  other  support  documentation  will  be  essential  to  the  evaluation, 
such  as  the  test  support  packages  and  deployment  plans  which  include  item  deploy¬ 
ment  density  and  mixes.  The  evaluator  should  be  prepared  to  extend  the  results 

of  the  OT  I  1  to  give  consideration  to  expectei  force  mixes  and  equipment  densities 
in  the  primary  theater  of  operation.  All  logistic  supportab i 1 i ty  issues  should 
be  addressed  and  resolved  prior  to  the  production  and  deployment  decision  at 
Milestone  Ml.  Depending  on  the  adequacy  of  the  logistic  support  system  and 
information  available,  the  evaluator  should  be  prepared  to  recommend  additional 
testing  for  logistic  data  generation  prior  to  the  production  and  deployment 
derision  or  during  follow-on  evaluation  testing  after  the  production  and  deploy¬ 
ment  decision. 

(6)  Operational  Test _ l_.  In  the  past,  OT  I  which  was  o  casionally  combined 

with  DT  I  included  use  of  soldier  operators  and  frequently  soldier  maintainers 

at  crew  and  organizational  level  while  contractor  personnel  conducted  all  mainte¬ 
nance  support  actions  above  organizational  level.  Typically,  the  logistic  concept 
was  very  general  and  no  attempt  was  made  to  implement  the  logistic  concept  because 
significant  logistic  elements  such  as  manuals,  tools,  and  test  equipment  were 
incomplete.  The  thrust  of  recent  changes  to  Army  policy,  particularly  as  stated 
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in  AR  1000-1,  is  that  evaluation  of  logistic  suppor tab i 1 i ty  will  bo  emphasized 
more  and  earlier  in  the  testing  cyc’e.  To  accomplish  this,  the  combat  developer, 
tester,  and  evaluator  should  emphasize  obtaining  the  necessary  resources  to  test: 
and  evaluate  the  logistic  system  to  the  maximum  degree  possible  at  0T  I  since 
required  changes  to  the  logistic  system  and  materiel  design  are  most  cost  effec¬ 
tive  when  identified  early.  The  following  guidelines  are  offered  for  logistic 
test i ng  at  0T  I : 

(a)  As  a  minimum,  typical  user  troops  should  operate  and  maintain  the 
system  at  operator/crew  and  organ i zat i c na 1  levels  and  Skill  Performance  Aids  (SPA) 
should  be  provided  and  used. 

(b)  It  is  also  reasonable  to  utilize  military  personnel  at  the  direct  support 
level  to  some  degree  in  accordance  with  the  logistic  concept.  Special  tools,  test 
equipment,  training  simulators,  calibration  equipment,  technical  manuals,  and 
Repair  Parts  and  Special  Tool  Lists  (RPSTLs)  should  be  available  to  some  degree 
for  testing  and  evaluation. 

(c)  it  is  highly  desirable  that  all  logistic  elements  be  defined  and  that 
elements  which  are  critical  to  the  evaluation  plan  be  reasonably  mature  for  test. 

Test  data  for  the  critical  elements  and  analysis  of  other  logistic  elements  which 
are  defined  but  not  yet  tested  (e.g..  logistic  support  concept,  transportability, 
etc.)  should  contribute  to  a  thorough  evaluation  of  logistic  suppor  tab  i  i  i  t:y 

fol lowi ng  0T  I . 

(7)  Operational  Testing  II.  The  purpose  of  0T  11  ‘ncludes  validation  of 
the  hardware  system  and  elements  of  the  system  support  package.  It  is  intended 
that  all  portions  of  the  logistic  support  system  be  demonstrated  and  tested  at 
0T  II  in  accordance  with  AR  1000-1.  The  following  guidelines  are  offered  for 
CT  I  !  : 
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(a)  All  maintenance  and  supply  personnel  should  be  selected  and  trained 

in  accordance  with  TRAQOC  approved  training  programs.  Routine  use  of  contractor 
technicians  to  perform  operator  through  GS  maintenance  is  prohibited. 

(b)  All  logistic  support  hardware  (e.g.,  repair  parts;  tools;  Test- 
Measurement,  and  Diagnostic  Equipment  (TMDE) ;  and  other  support  equipment) 
should  be  available  for  testing  and  be  used  in  every  required  mode  of  operation. 

(c)  Ail  logistic  support  software,  (e.g.,  technical  manuals  and  their 
contents  (i.e.,  repair  procedures,  RPSTL,  MAC)  in  SPA  format,  data  collection 
and  documentation  forms)  should  be  available  for  testing  and  be  used  as  written. 
Mo  system  will  be  permitted  to  enter  OT  II  without  SPA  or  a  formal  waiver  of 
SPA. 

(d)  The  logistic  concept  should  be  fully  developed  and  implemented  to  the 
greatest  extent  possible  during  the  test  to  include  definition  and  utilization 
of  facsimiles  of  the  logistic  organizations  with  appropriate  allocations  of 
responsibilities,  personnel,  and  mission-related  hardware  and  software. 

(e)  The  materiel/system  under  development  must  be  of  sufficient  maturity 
that  characteristics  which  affect  logistics  (such  as  design  for  maintainability, 
reliability,  human  factors,  transportab  i  1 i ty ,  handling  facilities,  frequency 

of  calibration)  represent  the  design  to  be  fielded. 

(f)  The  system  must  be  operated  in  a  realistic  field  environment  for  a 
sufficient  time  to  generate  adequate  logistic  requirements  at  all  field  e.chslcr.  • 
where  possible.  As  a  minimum,  all  opentor/crew,  organization,  and  most  Direct 
Support  (DS)  maintenance  actions  (scheduled  and  unscheduled)  should  be  observed 
or  simulated  where  time  to  occurrence  is  expected  to  be  excessive.  Actions  at: 
General  Support  (GS)  and  depot  level  in  unusual  cases  should  be  investigated  to 
the  degree  appropriate  to  the  logistic  conesot ;  e.g.,  to  validate  automatic 
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test  equipment  software  programs.  If  GS  is  a  backup  for  DS  and  GS  basically 
does  the  same  kind  of  work  as  DS  but  only  to  the  degree  that  DS  cannot  handle 
the  volume  of  work*  assessment  of  GS  may  be  of  little  value.  Conversely,  for 
logistic  concepts  which  minimize  DS  "wrench-turn ing"  and  place  the  substantial 
burden  on  GS,  assessment  of  GS  functions  become  much  more  important  than  DS, 

In  general,  review  the  logistic  concept,  determine  where  unique  work  require¬ 
ments  lie,  determine  where  bottlenecks  in  logistic  support  seem  likely  to 
develop,  and  then  thorougnly  examine  those  areas. 

(g)  Quantitative  data  should  be  collected  to  reflect  frequency  and 
magnitude  of  logistic  requirements.  Measures  of  frequency  include  operating 
hours  between  unscheduled  maintenance  requirements  for  each  category,  operat¬ 
ing  hours  between  scheduled  maintenance  for  each  category,  and  operational 
days  between  demands  for  repair  parts  by  type  and  category.  Measures  of 
magnitude  include  man-hours  for  repair  at  each  category,  time  waiting  in  each 
type  of  queue  for  manpower,  parts,  TMDF.  by  type  and  category,  number  of  repair 
parts  consumed  per  operating  hour  by  type  part  at  each  category,  aid  downtime 
or  turnaround  time  for  each  malfunction. 

(8)  Issues  and  Associated  Criteria.  Sample  issues  and  associated  criteria 
are  shown  here.  (Issues  measurable  by  the  criteria  must  be  based  on  operational 
requ i remen ts . ) 

(a)  Examp  1 e  1 . 

1  Ijjsue.  Is  the  logistic  support  concept  adequate? 

2  Scope .  This  issue  includes  the  examination  of  the  supply  and  mainte¬ 
nance  organization,  the  allocation  responsibilities,  the  allocation  of  hardware 
and  software,  and  the  allocation  of  personnel  as  contained  in  the  Doctrinal  and 
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Organizat ional  Test  Support  Package  and  reflected  in  other  documentation  such 
as  the  maintenance  allocation  chart.  (This  allocation  is  not  to  be  confused 
with  the  adequacy  of  the  characteristics  of  the  hardware,  software,  and  personnel 
which  are  addressed  elsewhere.) 

2  Cr i ter i a . 

a  The  supply  and  maintenance  organization  should  be  completely  described 
and  should  clearly  define  responsibilities  and  workflow  for  each  level  of 
supply  and  maintenance.  The  organization  should  be  such  that  a  minimum  of 
out-of-channel  workflow  and  coordination  is  necessary  so  that  work  may  be 
completed  in  a  smooth  and  efficient  manner. 

b^  Responsibilities  should  be  allocated  to  the  proper  level  within  the 
organization  and  appropriate  to  the  materiel  system  requirements  for  logistic 
support  to  include  maintenance  and  repair  parts;  Petroleum,  Oil  and  Lubricants 
(POL);  and  ammunition  resupply. 

£  Materiel  support  hardware  and  software  (e.g.,  tools,  repair  parts, 

TMDE,  and  other  support  equipment)  should  be  allocated  to  the  appropriate 
level  in  proper  number  and  type  for  efficient  functioning  of  the  logistic 
concept . 

2  Supply  and  maintenance  personnel  should  be  assigned  to  the  proper 
levels  and  location;  and  the  quantity  and  type  of  personnel  should  be  adequate, 
but  not  excessive  for  correct  and  efficient  supply  and  maintenance  support. 

( b )  Ex amp  1 e  2 . 

1  I ssue.  Are  the  logistic  support  materials  adequate? 

1_  ScojDe.  This  issue  includes  examination  of  the  logistic  support: 
hardware  and  software  necessary  or  desirable  for  support  of  the  materiel 
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system.  Logistic  support  hardware  includes  repair  parts,  common  tools,  all 
test  equipment,  calibration  equipment,  and  similar  resources.  Logistic 
support  software  includes  technical  manuals,  RPSTL,  MAC,  Parts  Allocation 
Chart  (PAC),  and  Lubrication  Orders  (LOs).  (Note  that  while  the  scope  of 
this  issue  addresses  the  contents  of  the  SSP,  its  purpose  is  not  to  address 
the  SSP  as  a  whole,  but  rather  the  adequacy  of  each  of  the  elements  of  the 
SSP  as  each  relates  to  support  of  the  system  as  a  whole.) 

3_  Cri  teria. 

a_  Repair  parts  should  be  of  proper  form,  fit,  and  function,  available 
in  adequate  quantity  at  each  maintenance  echelon,  contribute  to  simplicity 
of  repair,  and  be  standardized  to  the  maximum  extent  possible. 

b  Common  and  special  tools  should  perform  as  required,  be  durable, 
simple,  necessary,  and  easy  to  use. 

£  TMDE  and  calibration  equipment  should  be  safe,  accurate,  easy  to 
use,  reliable,  maintainable,  supportable,  and  listed  in  the  Army's  TMDE 
Register  (DA  Pamphlet  700-20,  Preferred  items  List  ( P 1 L ))  . 

d  Technical  manuals  and  other  software  should  be  comprehensible, 
complete,  and  easy  to  use  to  include  tables,  figures,  narrative,  and  indexing 
according  to  "Skill  Performance  Aids"  spec i f i cat i ons , 

e  Procedures  and  documentation  for  processing  work  orders,  repair  parts 
requests,  POL  resupply,  and  ammunition  resupply  should  be  consistent  with 
accepted  doctrine,  tactics,  and  organization. 

f  Materiel  handling  devices  and  resupply  and  maintenance  vehicles 
should  be  safe,  reliable,  and  maintainable. 

( c )  Examp  1 e  3 • 
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1  i  ssue.  Are  the  logistic  support  personnel  adequately  trained  and 
phys i ca 1 1 y/menta 1 1 y  skilled  to  perform  their  required  duties? 

2  Scope.  This  issue  includes  an  examination  of  the  basic  personnel 
selections*  the  prerequisite  skills  required,  and  an  evaluation  of  the 
training  program's  effectiveness  in  further  preparing  them  for  system 
support  in  the  field.  (The  scope  of  this  issue  includes  examination  of  the 
content  of  the  Training  Test  Support  Package  as  evidenced  by  personnel 
performance  during  test.) 

Cri  teria. 

£  Selection  of  logistic  support  personnel  should  take  into  consideration 
the  physical  requirements  of  the  duties  to  be  performed. 

£  Personnel  selection  processes  should  consider  the  mental  aptitude 
and  potential  for  effective  training  of  the  individual. 

c_  Prerequisite  skill  requirements  and  how  they  affect  the  planned 
training  program  should  be  considered  during  selection  of  logistic  support 
personne 1 . 

d  The  training  ogram,  given  the  personnel  selection  process  is 
effective,  should  prepare  logistic  support  personnel  to  adequately  perform 
their  required  duties  in  support  of  the  system  in  the  field. 

(d)  Example  4. 

1  I ssue.  How  adequately  is  the  test  item  designed  for  efficient  and 
effective  logistic  support? 

2  Scope .  The  issue  includes  the  characteristic  end  item  design  for 
efficient  logistic  suppor tab i I i ty  and  the  requirements  of  the  end  item 
for  logistic  support. 
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£  The  design  should  incorporate  consideration  of  maintainability,  safety, 
and  human  factors  engineering  for  effective  maintenance  and  supply  activities. 

b_  System  transportability  character i st i cs  should  be  consistent  with 
logistic  support  handling  capabilities  for  all  appropriate  modes  (e.g.,  land, 
sea,  air,  rail,  and  truck). 

c_  Requirements  for  supply  and  maintenance  facilities  should  be  consis¬ 
tent  with  facility  capabilities  and  allocations  as  described  in  the  logistic 
concept  and  should  be  minimized  to  the  extent  possible. 

d  Requirements  for  resupply  of  expendibles  such  as  ammunition  and  POL 
should  be  consistent  with  the  allocations  described  in  the  logistic  concept 
and  within  the  capabilities  of  support  materiel  and  support  personnel  to 
respond  as  needed. 

e_  Requirements  for  maintenance  manpower,  repair  parts,  and  other 
resources  should  be  consistent  with  the  logistic  concept,  capabilities  of 
the  support  hardware,  software,  and  personnel. 

6 .  Concl us  ions . 

a.  The  FYTP  and  TSARC  process  is  an  adequate  mechanism  for  acquiring 
supplementary  troop  support  for  user  testing  and  developmental  testing. 

b.  There  is  a  need  for  each  DARCOM  test  activity  to  maintain  a  staff  of 
experienced  SOMTE  personnel  representing  the  full  spectrum  of  user  and  main- 
tainer  skills  associated  with  the  kinds  of  systems  tested  by  that  activity. 

c.  The  TDA  of  each  DARCOM  test  activity  should  designate  spaces  as 
primary  SOMTE  spaces.  Such  personnel  would  be  available  for  full-time 
assignment  to  SOMTE  and  SOMTE- re  1  a  ted  activities. 
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d.  The  TDP  should  clearly  delineate  and  give  specific  guidance  for  SOMTE 
involvement  in  any  given  test  situation,,  SOMTE  personnel  can  be  effectively 
utilized  for  early  contractor  testing, 

e.  A  clear  distinction  must  be  made  in  evaluating  logistic  suppor tab i 1 i ty „ 
The  testing  of  the  SSP  is  not  to  be  confused  with  those  logistic  functions 
performed  to  provide  test  continuity.  The  planned  logistic  support  which 
should  be  tested  is  that  to  be  provided  with  the  fielded  system  to  determine 
the  capability  of  planned  support  to  sustain  operations  in  the  field, 

f.  Logistic  supportab  i  1 i ty  evaluations  are  not  meeting  the  intent  of 
current  acquisition  policies  which  require  that  weapon  systems  and  their 
respective  logistic  systems  be  evaluated  at  milestone  decision  points  to 
assess  suitability  characteristics  and  project  operational  readiness. 

g.  Test  programs  conducted  prior  to  Milestone  II  have  been  oriented 

toward  "proof  of  design  concept"  with  little  emphasis  on  logistic  supportab i 1 i ty , 

h.  Test  plans  and  policies  should  take  account  of  the  fact  that  not  all 
elements  of  logistic  support  will  be  available  in  their  mature  configuration 
for  testing  prior  to  Milestone  III. 

i.  The  SSP  should  be  identified  early  in  the  life  cycle  program  as  a 
distinct  entity  and  should  be  clearly  stated  as  such  in  all  contracts  for 
both  prototype  and  production  items. 

j.  One  of  the  key  problems  related  to  logistic,  suppor  tab  i  1  i  ty  is  the 
lack  of  weapon  systems  procotype  availability  during  the  development  phases 
to  prepare  required  manuals  and  other  essential  logistic  programs.  This 
problem  can  be  resolved  by  providing  an  additional  prototype  of  the  weapon 
system  which  would  be  devoted  solely  to  logistic  suppor tab i 1 i ty  testing 
during  the  FSED  phase. 
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ko  Sufficient  hardware,  time,  and  planning  are  not  assigned  to  PT/LD, 
Sufficiently  matured  versions  of  SSP  are  not  provided  for  test;  and  thus, 
logistic  suppor tab i 1 i ty  testing  never  seems  to  end  because  it  is  spread  out 
over  the  developmental  time  span, 

1  .  Concepts  presented  in  this  study  will  require  changes  to  regulatory 
guidance  related  to  logistic  supportab i 1 i ty  testing  and  evaluation, 

m.  Tor  logistic  suppor tab i 1 i ty  testing  to  be  given  proper  attention  and 
emphasis,  it  would  be  highly  desirable  to  conduct  a  dedicated  nonwa i verabl e 
Logistic  Support  Evaluation  (LSE)  as  a  subtest  of  both  DT  II  and  OT  II, 
Emphasis  would  be  directed  to  testing  a  complete  SSP  or  those  elements  of  the 
SSP  not  previously  tested, 

n,  Life  cycie  logistic  support  testing  conducted  prior  to  the  Logistic 
Support  Evaluation  (LSE)  should  be  limited  to  that  effort  needed  to  assure 
sufficiently  matured  elements  of  support  are  available  at  the  time  of  the  LSE, 
Early  logistic  testing  efforts  could  well  be  considered  as  an  integral  part 

of  the  end  item  tests  and  not  scored  separately. 

7,  Recomrnendat  ions ,  It  is  recommended  that: 

a.  Each  DARCOM  test  activity  designate  certain  positions  on  their  TDAs 
as  SOMTE  spaces,.  These  positions  are  to  be  further  categorized  by  their 
commitment  to  SOMTE  activities  such  as:  primary,  auxiliary,  or  temporary;  or 
by  the  level  of  their  qualifications  as  senior,  intermediate,  or  junior, 
b„  The  TOP  clearly  define  SOMTE  responsibilities  in  any  given  test 
.» i  tuat  ion, 

c.  At  least  two  prototypes  be  procured  for  the  FSED  phase  of  the  acquisi¬ 
tion  cycle,  the  second  prototype  to  be  dedicated  exclusively  for  SSP/SPA 
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purposes  tc  insure  that  logistic  supportab i 1 i ty  and  training  programs  proceed 
at  the  pace  required  for  testing  and  implementation  of  the  logistic  and 
training  functions.. 

d.  Each  contractor  be  required  to  prepare  and  execute  a  Logistic  Support 
Analysis  (LSA)  plan  which  provides  LSAR  output  summaries  at  the  appropriate 
time  to  support  preparation  of  draft  documentation. 

e.  With  the  availability  of  a  dedicated  prototype  for  SSP  purposes, 
insure  that  a  satisfactory  PT/LD  is  performed  using  MOS  qualified  personnel, 
the  PT/LD  to  be  performed  using  validated,  baseline  LSAR  output  reports  and 
draft  copies  of  TMs ,  ETMs,  PLs,  and  MACs. 

f.  A  dedicated  nonwa i verab 1 e  Logistic  Support  Evaluation  (LSE)  be  con¬ 
ducted  as  a  subtest  of  both  DT  I  I  and  OT  II,  emphasis  to  be  placed  on  testing 
those  elements  of  the  SSP  not  previously  tested. 

g.  SOMTE  personnel  be  utilized  for  early  contractor  testing. 

h.  Logistic  Support  Evaluation  (LSE)  test  results  be  submitted  for 
consideration  of  an  I  PR  which  would  assess  the  impact  on  planned  deployments, 
assign  corrective  actions,  and  inform  CARCOM  and  Army  management. 

i.  Regulatory  guidance  related  to  logistic  supportab i 1 i ty  test  and  evalua¬ 
tion  be  changed  as  presented  in  Appendix  A„ 
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1*  AR  1000-1,  Basic  Policies  for  System  Acquisition,  1  Hay  1981. 

a.  Recommend  that  the  following  statement  be  added  to  Paragraph  2-10n: 

The  System  S  pport  Package  (SSP)  should  be  identified  early 
in  the  life  cycle  program  as  a  distinct  entity  and  should  be 
clearly  stated  as  such  in  all  contracts  for  prototype  and 
production  items. 

bo  Recommend  that  the  following  statment  be  added  to  Paragraph  2-20k: 

The  Coordinated  Test  Program  (CTP)  and  Test  Integration 
Working  Group  (TIWG),  if  one  is  planned,  should  be 
established  prior  to  contract  award.  The  CTP  must  specifi¬ 
cally  document  SSP  requirements  and  should  be  included  as 
part  of  the  system  contract. 

2.  DARCOM-R  700-15,  Integrated  Logistic  Support  (ILS),  26  November  1979. 

a.  Recommend  that  the  fol 'owing  statement  be  added  to  Paragraph  1-7, 
General  Pol i ci es : 

The  System  Support  Package  (SSP)  should  be  identified 
early  in  the  life  cycle  program  as  a  distinct  entity 
and  should  be  clearly  stated  as  such  in  all  contracts 
for  both  prototype  and  production  items. 

b.  Add  to  Paragraph  l~7e: 

Each  contractor  should  be  required  to  prepare  and  execute 
a  Logistic  Support  Analysis  (LSA)  plan  which  provides 
LSAR  output  summaries  at  the  appropriate  time  to  support 
the  preparation  of  draft  documentation. 

3.  DA  Pamphlet  700-127,  Integrated  Logistic  Support  Management  Model  and 
G 'ossary,  Apr! i  1979- 

a.  Recommend  that  the  following  be  added  to  D-5-  Event  1*5.2:  Physical 
T  ea  rdown ; 

A  dedicated  prototype  and  qualit  fed  troops  are  required 

to  support  a  satisfactory  Physical  Teardown/Log  i  s  t:  i  r  Demons  t  rat  ion 

(PT/l.D).  The  Pi/LD  should  lie  conducted  using  validated,  base  line  LSAR 


output  reports  and  draft  copies  of  Technics!  Manuals  (IMs), 

Extension  Training  Materials  (t'TMs),  Provisioning  Lists 
(PLs),  and  Maintenance  M location  Charts  (MACs). 

b.  Recommend  that  the  following  statement  be  added  to  D-14.  Event  51/52. 

Specifically  under  Description:  Paragraph  b: 

For  logistic  suppor tab i 1 i ty  testing  to  be  given  proper 
attention  and  emphasis,  it  would  be  highly  desirab.e  to 
conduct  a  dedicated  nonwa i verabl s  Logistic  Support  Evaluation 
(LSE)  as  a  subtest  of  both  DT  II  and  01  II.  These  assessments 
would  be  conducted  within  tne  normally  prescribed  settings 
already  established  for  conducting  DT/OT  II  but  would  emphasize 
and  be  dedicated  to  logistic  supported : 1 i ty  problems. 
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A 

AAH 

AEGIS 

AMSAA 

AR 

ASARC 

ASL 

£ 

COEA 
CTP 
CTP  I 
CTP  I  I 
CTP  ill 

£ 

DA 

UARCOM 

DCGMR 

DS 

DSARC 

DT 

DT/OT 
DT/OT  I 
DT/OT  I  I 
DTP 


EER 

ETM 


Advanced  Attack  Helicopter 

A  Naval  Missile  System 

Army  Materiel  Systems  Analysis  Activity 

Army  Regulation 

Army  System  Acquisition  Review  Council 
Authorized  Stockage  List 


Cost  and  Operational  Effectiveness  Analysis 
Coordinated  Test  Program 

Coordinated  Test  Program  I  (Validation  Phase) 

Coordinated  Test  Program  !l  (Full  Scale  Development  Phase) 
Coordinated  Test  Program  III  (Product  and  Deployment  Phase) 


Department  of  the  Army 

US  Army  Materiel  Development  and  Readiness  Command 
Deputy  Commanding  General  for  Materiel  Readiness 
Direct  Support 

Defense  System  Acquisition  Review  Council 
Developmental  Testing 

Testing/Operational  Testing 
Testing/Operational  Testing  I 
Testing/Operational  Testing  li 
Plan 


Developmental 
Developmental 
Developmenta I 
Detailed  Test 


Enlisted  Efficiency  Report 
Extension  Training  Materiel 


FA- I PT 
FORSCOM 
FSED 
FY 

FYTP 


First  Art icl e- I n i t ial  Production  Test 
US  Army  Forces  Command 
Full  Scale  Engineering  Development 
Fiscal  Year 

Five  Year  Test  Program 


r  -  l 


General  Support 


GS 
H 

HFE  Human  Factors  Engineering 

HQ  DARCOM  Headquarters ,  US  Army  Materiei  Development  and 

Read i nes s  Command 


\_ 

IE 

IEP 

IER 

ILS 

IOC 

IPR 

L 

LCMM 

LO 

LSA 

LSAR 

LSE 

L50 

M 

MAC 

MOS 

MRC 

MRSA 

MTSP 

N_ 

NCO 


Independent  Evaluation 
Independent  Evaluation  Plan 
Independent  Evaluation  Report 
Integrated  Logistic  Support 
Initial  Operational  Capability 
In-Process  Review 


Life  Cycle  Management  Model 
Lubrication  Orders 
Logistic  Support  Analysis 
Logistic  Support  Analysis  Record 
Logistic  Support  Evaluation 
Logistics  Studies  Office 


Maintenance  Allocation  Chart 

Military  Occupational  Specialty 

Materiel  Readiness  Command 

US  Army  Materiel  Readiness  Support  Activity 

Maintenance  Test  Support  Package 


Noncommissioned  Officer 


0 

01 
0T  I 

0T  I  I 

OTEA 

OTP 


Operational  Testing 
Operational  Testing  I 
Operational  Testing  II 

US  Army  Operational  Test  and  Evaluation  Agency 
Outline  Test  P i an 
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p 


PAC 

PATRIOT 

PiL 

PLL 

PM 

PMO 

PT/LD 


Parts  Allocation  Chart 

A  Term  Used  for  an  Army  Surface-to-Ai r  Missile  System 

Preferred  I  terns  List 

Prescribed  Load  List 

Project  Manager 

Project  Manager's  Office 

Physical  Teardown/Log i st i c  Demonstration 


R 

RAM 

R&D 

RDT&E 

RPSTL 

RS 

S 

SDC 

SINGARS 

SOMTE 

SPA 

SSP 

SQT 

T 

TDA 

TDP 

TDY 

T&F. 

TECOM 

TEMP 

TIWG 

TM 

TMDE 

TO&E 

TRADOC 

TSARC 

U 


Reliability,  Availability,  and  Maintainability 
Research  and  Development 

Research,  Development,  Test  and  Evaluation 
Repair  Parts  and  Special  Tool  List 
Resume  Sheet 


Sample  Data  Collection 

Single  Channel  Ground  and  Airborne  Radio  Subsystem 
Sol d i er/Operator/Ma i nta i ner  Test  and  Evaluation 
Skill  Performance  Aids 
System  Support  Package 
Skill  Qualification  Tests 


Table  of  Distribution  and  Allowances 
Test  Design  Plan 
Temporary  Duty 
Test  and  Evaluation 
US  Army  Test  and  Evaluation  Command 
Test  and  Evaluation  Master  Plan 
Test  Integration  Working  Group 
Technical  Manual 

Test,  Measurement  and  Diagnostic  Equipment 
Table  of  Organization  and  Equipment 
US  Army  Training  and  Doctrine  Command 
Test  Schedule  and  Review 


US  Army  Security  Agency 
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USASA 
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DEFINITIONS 


M CLjOA.  SiJ&ZejM  -  Major  system:-  include  those  which  qualify  for  decision  by 
the  Defense  Systems  Acquisition  Review  Council  (DSARC) ,  and  others 
which  are  critically  important  to  the  Army,  ore  complicated,  expensive, 
or  controversial,,  or  for  any  reason  would  involve  the  ton  management  of 
the  Army  (AR  lOGO-l).  These  programs  normal!/  have  Research,  Develop¬ 
ment,  Test  and  Evaluation  (RDTE)  costs  in  excess  of  $75  million  or 
procurement  costs  in  excess  o'  $300  million. 

Slcn.ma.jon  Sy&tdmt,  -  Systems  which  do  not  meet  the.  criteria  for  designation  as 
major  systems  and  which  normally  undergo  In-Process  Review  (!PR)  are 
divided  into  the  following  categories  for  Operational  Testing  ( 0T ) 
managemen  t : 

0  Cout2.QOh.iJ  7,  Systems  selected  by  DCSOPS  in  coordination  with  the  US 
Army  Operational  Test  and  Evaluation  Agency  (OTEA)  for  which  0T 
is  conducted  by  OTEA.  Materiel  acquisition  decisions  supported 
by  this  0T  will  be  approved  by  HQ.DA  or  higher  authority.  These 
systems  normally  have  RDTE  costs  less  than  $75  million  or  procure¬ 
ment  costs  less  than  $300  million. 

0  CaXigohy  II.  Systems  which  have  Chief  of  Staff,  Army  (CSA  or  higher 
interest,  potential  high  cost  or  support  requirements,  j ten t i a  1 

escalation  to  a  major  system  or  a  Category  I  nonmajor  system 
designation,  or  close  ties  with  assigned  OTEA  system,  and  which 
have  0T  conducted  by  the  US  Army  Training  and  Doctrine  Command 
(TRADOC),  US  Army  Communications  Command  (ACC),  The  Surgeon 
General  (TSG) ,  or  other  designated  operational  testers.  These 
systems  normally  have  combined  RDTE  and  procurement  appropr i at  ions 
which  exceed  $25  million  threshold. 

0  CatzgOhiJ  III.  Systems  which  normally  have  combined  RDTE  and  procure¬ 
ment  appropriations  between  a  $10  and  $25  million  threshold. 
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